LOCUS OF INDETERMINACY OF THE PRYM MAP 



VITALY VOLOGODSKY 

Abstract. We provide an easy characterization for the locus of inde- 
terminacy of the Prym map in terms of the dual graphs of stable curves. 
As a corollary, we show that the closure of the Fridman-Smith locus 
coincides with the locus of indeterminacy of the Prym map. 



0. Introduction 



This paper is intended to be an appendix to the [ABH] and here we are 



using notations and results of |ABH|1 



The extended Prym map is a rational map from the moduli space R g of 
stable curves C of genus 2g — 1 with an involution i, where the only base 
points of i are nodes and the involution does not exchange branches at that 
node, to the space ^4™ r i, the toroidal compactification of -A s -i for the 2nd 
Voronoi fan. On the dense open subset in R g corresponding to smooth curves 
it is given by associating to a pair (C, i) its Prym variety P(C,i). Locus of 
indeterminacy of this map was described in [ABH] by a condition (*) using 



the combinatorial data of the dual graph of a curve with an involution. This 
paper gives an easier description for the indeterminacy locus. 

Theorem 0.1. A curve with an involution is in the indeterminacy locus 
of the extended Prym, map if and only if the curve is a degeneration of a 
Friedman- Smith example with the number of edges 4 or greater. 

Recall that the Friedman-Smith example with 2n edges is a curve (C, i) £ 
R g , such that the curve C = C\ U C2 is the union of two irreducible com- 
ponents, both invariant under the involution, intersecting in 2n points, so 
that the involution is base point free and interchanges these 2n nodes. 

For n>2 the closure of the Friedman-Smith locus with 2n edges contains 
[ g ~2 + 1 + 1 irreducible components. Curve C = C/i is the union C = 
C[L)C2 of two irreducible curves of genuses g[ and g' 2 , where g'i+g'2 = g—n+l. 
Irreducible components of the Friedman-Smith locus correspond to cases 
when g[ and g' 2 are (0,g-_n + 1), (l,g -n), ... , ([^], [^]). 

Note that in our space R g there are no stable curves having double points 
with the 2 branches exchanged by the involution (called the nodes of type 
(2) in gBj ). 
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1. Preliminary results 

We will call a vertex of the dual graph a bold vertex if the corresponding 
component of the curve is fixed by the involution and we will call an edge 



a bold edge if the corresponding node is a node of type (1), see | ABH | for 
definition. We will call all other vertices and edges ordinary. Note that if we 
have a bold edge then its beginning and the end are bold vertices. Therefore, 
the union of bold vertices and edges forms a subgraph of the dual graph. 
We will denote this subgraph by B(T). 

Proof of one direction for the Theorem p. II is immediate. 



Proposition 1.1. If the curve is a degeneration of a Friedman-Smith ex- 
ample with at least 4 edges, then the curve is in the indeterminacy locus of 
the Prym map. 



Proof. Prym map is not defined for the Friedman-Smith examples, see [FS] 



or |ABH] Section 4.2.3. The indeterminacy locus for every rational map is 



closed, therefore degenerations of the Friedman-Smith examples are also in 
the indeterminacy locus. □ 

Let us consider the dual graphs which are not degenerations of Friedman- 
Smith examples with the number of edges at least 4. 

Lemma 1.2. // the dual graph T of a stable curve C with an involution 
contains two disjoint connected equivariant subgraphs Ti and T2 which are 
connected by at least 4 ordinary edges ( so that the beginnings of these edges 
are in one subgraph and the ends are in the other), but are not connected by 
any bold path then this curve is a degeneration of a Friedman- Smith example 
with at least 4 edges. 

Proof. We will construct two disjoint equivariant subgraphs and T 2 such 
that together they contain all vertices of the graph T and every edge of T 
either belongs to one of the subgraphs or T' 2 or is an ordinary edge which 
begins at one subgraph and ends at the other. 

To find these T[ and T 2 we will take Ti and T2 and start adding to them 
vertices and edges until we will get required and T' 2 . 

First let us consider connected components of the bold subgraph -B(r). 
Each bold component cannot intersect with both subgraphs T± and T2, 
otherwise we have a bold path connecting these subgraphs. We will change 
each Ti by the union of r, and all components of B(T) which has non 
empty intersection with Tj. It is easy to see that the new T\ and T2 still 
satisfy all the conditions from the statement of the Lemma. In addition, the 
compliment r\(ri U is attached to Ti U T2 through the ordinary edges 
only. 
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Next let us consider the following topological space r\(ri U F2). Con- 
nected components of this space can be of three different types: 

1) components attached to Ti only, 

2) components attached to T2 only, 

3) components attached to both T\ and T2- 

We will change Ti by the union Ti U (all components of type 1) and T2 
by T2 U (all components of type 2). Again, T\ and T2 still satisfy all the 
conditions from the statement of the Lemma. 

Now, to get desired T[ and T' 2 , we can take r[ to be equal Ti. For vertices 

of T' 2 we will take all vertices of T which are not from subgraph and for 

edges of V 2 we will take all edges whose beginning and ends are vertices of 

V 
1 2- 

Note that the number of edges connecting and T' 2 is at least the same 
as the number of edges connecting original Ti and T2, which is not less then 
4. 

Consider decomposition of the curve C = C\ U C2 where each corre- 
spond to subgraph Each part C{ is invariant with respect to involution 
and can be obtained as a degeneration of smooth curves with involution. 
Then the whole curve C is a degeneration of the Friedman-Smith example 
and as we have noticed the number of nodes is at least 4. □ 



2. Condition (*) 

Let us fix an orientation on the graph V which is compatible with the 
involution i. Following [ ABH | edges ej give coordinate functions on Ci(r, M). 
We have three possibilities: 

1. Zj is identically zero onl". 

2. Image zj(X~) = Z. 

3. Image zj(X~) = ^Z. 

From [ABHj we have the following combinatorial condition 
(*) The linear functions rrijZj define a dicing of the lattice X~. 

In this dicing we are not using functions of type 1, rrij = 1 for the functions 
Zj of type 2 and rrij = 2 for the functions Zj of type 3. 

Another characterization of possibilities 2 and 3 for image zj(X~) is as 
follows. Image Zj(X~) = Z if for every simple oriented cycle uj G H 1 ^,^) 
in the graph F mult ej uj = 1 implies mult e . (i) uj = —1. Image zj(X~) = ^Z 
if there exists a simple oriented cycle uj 6 ff 1 (r,Z) with mult ej . uj = 1 but 
mult e ., u = 0. 

Let d be the dimension of the space X~ ® M. Then condition (*) is 
equivalent to the following: 

If the intersection of d hyperplanes {mj k Zj k = nj k ,rij k G Z, k = 1, . . . , d} 
is 0-dimensional (i.e. a point), then it is in the lattice X~ . 
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It is enough to check this condition for the sets of {rij k , k = 1, . . . , d} where 
all except one n, fe are and the remaining rij k is 1. If the intersections of 
hyperplanes corresponding to these sets {rij k , k = l,...,d} are in the lattice 
X~ then, since all other {rij k , k = 1, ... ,d} are integer linear combinations 
of those sets, their corresponding intersections of the hyperplanes are integer 
linear combinations of elements from X~ , and therefore belong to X~ . 



We can reprove Proposition 1.1 without using the geometrical meaning 
of condition (*). 

Proof. Let curve C be a degeneration of the Friedman-Smith example with 
2n edges with n > 2. Thus curve C is a union C\ U C2 where each Cj is a 
degeneration of a family of smooth curves and intersection C\ H C2 consists 
of n pairs of exchanged nodes. Then in the dual graph for C there are 
two equivariant subgraphs T\ and T2 corresponding to C\ and C2 and these 
subgraphs Ti and T2 are connected by the n pairs of exchanging edges. We 
will denote them ei,e[ = i(ei), . . . , e n , e' n = i(e n ). It is clear that these 
edges are of type 3. In definition of condition (*) all rrij corresponding to 
ei^,. . .,e n ,e' n equal 2. 

Now if we have an arbitrary simple cycle uj then either it does not con- 
tain any of the edg es ei, 6jj . . . , e n , c! n or it passes through even number 
of them. With counting multiplicities the sum uj — i(u) passes through 
ei, . . . , e n the same even number of times. All the elements of the lattice 

X~ are of the form ^-(^kiuji) where k\ G Z and u>i are simple oriented 

I 

n 

cycles. Therefore for any element of X~ we have Yl mvL ^e m (^ 1 (Y^i UJ i)) 

m=l I 

is an integer. We can choose some d — n edges e Jn+1 , . . . , e Jd with the func- 
tions Zj n+1 , . . . , Zj d so that the intersection of d hyperplanes {2zi = 1, 2z2 = 
0, . . . , 2z n = 

> m j n +i z jn+i ~ 0' • • • i m jd z jd ~ 0} ^ S 0-dimensional. But the 

n 

point of intersection x cannot be an element of X~ since ^ mult em (x) = \ 

m=l 

is not an integer. Condition (*) fails. □ 



To finish the proof of Theorem |0.l| , let us prove the other direction in its 
statement. 

Let us compare functions Zj and z^ when restricted to X~ . Elements 

L-] 

2 



of X are of the form ^^-(^ h^i) where k\ € Z and u>i are simple oriented 



cycles. 1£ui= Yl e i m tnen 



m=l 

length„ ; length^j 



i m=l I m=l 



Since the orientation of the graph T is compatible with the involution i we 
have i(ei m ) = +ei(« m ) and thus Zj = —Z{(j) when restricted on X~. 
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Intersection of d hyperplanes {mj k Zj k = nj k ,rij k G Z,k = 1, ...,d} is 

O-dimensional if and only if the intersection of {ra, Jk Zj k = 0,k = 1, . . . ,d} 

is € X~ ® R. The later is equivalent to {rrij k Zj k = 0,mj k z i ^ k ^ = 0, k = 

1, . . . ,d} having intersection G X~ <g) R. Note that Zj(uj) = z^(u) = 

for an element uj G X" is equivalent to the fact that oj can be represented 

as ^ ( J2 h^l) where all u\ are simple cycles in T not passing through ej 
i 

or ej(j). Therefore intersection of {irij k Zj k = 0,mj k z^j k ^ = 0, fc = 1, . . . , n} 

consist of the elements of X~ of the form ^ ( ^ u>i) with G i7 1 (r\(e J1 U 

i 

ej^) U • • • U ej n U ejfj n )), Z). Finally, intersection of d hyperplanes {mj k Zj k = 
n jki n jk ^ ^ik = l,...,d} is O-dimensional if and only if for the graph 
T' = r\(e J1 U e^j^ U • • • U e Jn U ei(j n ) ) all elements uj £ H 1 (V , Z) are invariant 
with respect to i. 

In the case of O-dimensional intersection let us look closely at the subgraph 
r'. It may have more than one connected component. But it is impossible 
that two of these components are exchanged by the involution. Indeed, for 
connected curve with involution dimension of the corresponding X~ can 
be computed as n e — c e where 2n e is the number of exchanged under the 
involution nodes (nodes of type (3)) (or the number of ordinary edges in the 
dual graph) and 2c e is the number of exchanged components (or the number 
of ordinary vertices). For the graph V we have n e — c e = d. Subgraph V' 
was obtained by erasing 2d ordinary edges, thus for T' we have n e — c e = 0. 
Now X~ for r' is 0, so for every invariant under the involution connected 
component of V we must have n e — c e = 0. Components of V exchanged 
by i consist of ordinary vertices and ordinary edges only. To have X~ = 
for T' all exchanged components should have no cycles. Then they are trees 
and for each of them n e — c e = — 1. If the exchanged components present in 
T' then for V n e — c e would be negative. All connected components of T' 
are fixed under i. 

Now consider the point of intersection for the hyperplanes {rrij 1 Zj 1 = 
^ m ik z ik =0,fc = 2,...,d}. 

If the edge ej 1 has the beginning Vj 1 and the end v'^ at the same connected 
component of T' then there is a path t inside of V which starts at v 1 ^ and 
ends at Vj x . Cycle to = t + ej 1 has mult eji to = 1 but mult e . (ii) u = 
which means that rrij 1 = 2. Now the element x~ = ^(u) G X~ satisfies 
{rrij l Zj 1 (x~) = l,rrij k Zj k (x~) = 0, k = 2,...,d}. The point of intersection 
of the hyperplanes is in X~ . 

If the edge ej 1 has the beginning Vj 1 and the end v'^ in different com- 
ponents of T' then the edges ej 1 and start (resp. end) at the same 
component. There is a path t inside of V which starts at Vj 1 and ends at 
iivj-t). Similarly, there is a path t' inside of V which starts at v'^ and ends 
at iiy'j^). u> = ej 1 +t' — e^j^ — t is a cycle in V. Element x~ = ^-{u) G X~ 
satisfies {zj 1 (x~) = 1, zj k (x~) = 0, k = 2, . . . , d}. To see that x~ is the point 
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of intersection for the hyperplanes {mj 1 Zj 1 = 1, rrij k Zj k = 0, k = 2, . . . , d} we 
need to show that rrij 1 = 1. 

We will show that if there exists a simple oriented cycle co G -ff 1 (r, Z) with 
mult eji u; = 1 but multj( ej . ) u = then T is a degeneration of Friedman- 
Smith example with at least 4 edges. Cycle to goes along some of the edges 
ej k and e$y fc ) and passes through some connected components C±,. . .C\ of 
the subgraph V . We can assume that the edge ej 1 starts at C\ and ends at 
Ci- Cycle u is simple so it cannot reenter C\ along ej 1 . multj( e ) u> = 0, so 
u) cannot reenter C\ along ^(e^). There is another edge e' through which 
uj reenters C\. Let T l = d, T' 2 = (C 2 U • • • U Q) U (w\(Ci U U e')) and 
r2 = T' 2 U ^(rg). Subgraphs Ti and T 2 are connected by at least 4 ordinary 
cd ges: € j k , ei(j h ), e' and i(e'). Therefore, they satisfy the assumptions of the 
Lemma 1.2 and graph T is a degeneration of Friedman-Smith example with 
at least 4 edges. 



This proves Theorem 0.1 



3. Condition ( 



In this section we will discuss condition (**) of |ABH ] which is stronger 



than condition (*). When condition (*) holds but (**) fails we have a Prym 
variety corresponding to the double cover of stable curves but this Prym 
cannot be canonically embedded into the Jacobian of the covering curve. 



From | A-BH | we have the following definition of combinatorial condition 

(**) [A - ] is a dicing with respect to the lattice 2X~ . 

In the notations of the previous section this condition (**) is equivalent 
to the following: 

If the intersection of d hyperplanes {zj k = nj k ,nj k € Z, k = 1, . . . ,d} is 
0-dimencional (i.e. a point), then it is in the lattice 2X~ . 

The first condition of the following theorem gives an easier description for 

Theorem 3.1. The following three conditions are equivalent 

(i) Curve is not a degeneration of a Friedman- Smith example with the 
number of edges 2 or greater. 

(ii) Condition (*) holds and there are no functions Zj of type (2). 
(Hi) Condition (**) holds. 

Proof, (i) implies (ii). If (*) does not hold then (**) does not hold either. 
We only need to show that if (*) holds but the graph has an edge ej with 
the corresponding function Zj of type (2) then the graph is a degeneration 
of a Friedman-Smith example with 2 edges. 

Let Vj be the beginning of ej and v'j be the end of ej. Let us consider 
connected components of r'- = T\(ej U e^). The number of components 
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is at most 3. If there is only one component in 1^- then there is a path t 
in connecting Vj and v'j. Thus for the simple cycle oj = ej — t me have 
mult ej . oj = 1 and m\At e .,.. oj = which is impossible since ej is an edge of 
type 2. If there were three components in 1^- then edges ej and e^ would 
have been of type 1. The only possibility is when 1^- has two components 
and Fj 2 - Since for every simple cycle oj we have mult ej oj = — mult e . (j) oj 
then beginnings Vj and v'- belong to the same component of 1^, say F'- v 
Therefore T'^ is invariant with respect of involution i and so is T' i2 . Now 
consider decomposition of the curve C = C\ U C2 where each Ck correspond 
to subgraph T'- k . Each part Ck is invariant with respect to involution and 
can be obtained as a degeneration of smooth curves with involution. Then 
the whole curve C is a degeneration of the Friedman-Smith example with 
the number of edges 2. 

(ii) implies (i). Assume that (i) fails. The curve C is a degeneration of 
a Friedman-Smith example with 2 edges. Thus curve C is a union C\ U C2 
where each Cj is a degeneration of a smooth curve and intersection C\ n C2 
consists of two exchanged nodes. Then in the dual graph for C there are 
two equivariant subgraphs T\ and T2 corresponding to C\ and C2 and these 
subgraphs Ti and T 2 are connected by the pair of exchanging edges. It is 
clear that these edges are of type 2. 

(ii) implies (Hi). Since there are no edges of type 2 then in definition of 
condition (*) all nij equal 2. Condition (*) holds, so if the intersection of d 
hyperplanes {2zj k = nj k ,rij k 6 Z, k = 1, . . . , d} is O-dimensional, then it is 
in the lattice X~ . Thus intersection of {2zj k = 2rij k ,nj k G Z, k = 1, . . . , d} 
is in 2X~ , but this is the same point as intersection of {zj k = nj k ,iij k 6 
Z, k = 1, . . . , d}. Therefore condition (**) holds. 

(Hi) implies (ii). Let us take an arbitrary edge ej and the corresponding 
function Zj. If Zj is nontrivial (i.e. not of type 1) then we can choose some 
d—1 edges e j2 , . . . , ej d with the functions Zj 2 , . . . , Zj d so that the intersection 
of d hyperplanes {zj = l,Zj 2 = 0,...,Zj d = 0} is O-dimensional and by 
condition (**) is some point 2x~ € 2X~ . Now x~ G X~ and Zj(x~) = \. 
Thus edge ej and the corresponding function Zj are of type 3 and not of 
type 2. 

□ 
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